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Collecting, Reviewing, and Acting on Evidence for Using 
Technology to Enhance Academic Performance 
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Grade in School 


Figure 1 . A graph of the achievement 
gap illustrates the difference between 
expected outcomes and student 
performance among under-performing 
populations. 


T he “achievement gap” is a 

well-documented problem in 
schools. In practical terms, the 
problem can be illustrated in a graph 
(Figure 1). The diagonal line illustrates 
the intended learning outcome: one 
year of academic achievement for each 
year in school. However, the dotted 
line illustrates the pattern of achieve- 
ment of many under-performing 
students, including students of color, 
those with disabilities, those living in 
poverty, and those whose first lan- 
guage is not English. The area between 
the dotted line of performance by 
low achievers and the diagonal line of 
expected grade-level performance is 
known as the achievement gap. Con- 
cern about chronic underachievement 
is one of the core tenets of the federal 
education reform law known as No 
Child Left Behind (NCLB), as shown 
in the law s emphasis on measuring 
adequate yearly progress. 

Lessons Learned 

The lessons of the achievement gap 
are clear: 

• Contemporary schooling prac- 
tices are not effective for some 
groups of students. 

• Continuing to do what we have 
always done will perpetuate rather 
than eliminate the gap. 

• Repeated failure over time cre- 
ates an achievement gap that is 
exceedingly difficult to erase. 


How long do we allow students to 
fail at a given task before we provide 
them with appropriate performance 
support tools? When students are 
unable to experience success in a 
learning activity, there is still a learn- 
ing outcome: Students learn that 
they don t like the subject matter and 
internalize the failure in ways that re- 
flect the idea that they are “no good” 
in the subject. Indeed, the emotional 
scarring of this process is so power- 
ful that these negative outcomes are 
transmitted generationally. What 
teacher has not had the experience at 
parent-teacher conferences where the 
first explanation a parent provides for 
his sons or daughter s academic failure 
is, “Well, I was never very good at that 
in school.” 

It appears that academic failure has 
a lifelong effect in closing doors to 
learning and opportunity. The lessons 
of the achievement gap suggest that 
our historical decisions about when to 
intervene with performance supports 
are seriously flawed. In short, perfor- 
mance support interventions must be 
provided much sooner than they have 
ever been considered in the past. 

An Academic Performance Problem 

Schools routinely evaluate academic 
performance. Every classroom has 
extensive systems in place to identify 
inadequate, adequate, and exceptional 
performance. Figure 2 illustrates the 
daily algebra homework scores of four 
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ninth grade students. Which graph 
illustrates: 

• a student who is successfully 

achieving? 

• a student who is non-engaged? 

• a student with inconsistent 

performance? 

• a consistently low performing 

student? 

Rather than addressing the issues 
of poor performance, educators often 
search for reasons to explain poor 
performance, become sidetracked, 
and fail to intervene with appropriate 
supports. However, without knowing 
all the reasons, perhaps we can agree 
that the performance profile of three 
of the four students provides clear evi- 
dence of a performance problem. 

Unfortunately, schools have been 
failing large numbers of students long 
before NCLB was around. The prob- 
lem is not about performance stan- 
dards. Rather, do we have a respon- 
sibility to do more than simply fail 
students who are not benefiting from 
the current models of one-size-fits-all 
instruction? If a child has repeatedly 
failed, how much failure data do we 
need before we have enough evidence 
that the child cant perform the task? 
When do we intervene? And, what do 
we do? 

Evidence of an academic perfor- 
mance problem requires that we 
respond quickly and differently to 
signs of academic failure. Research on 
human performance technology illus- 
trates the palette of interventions for 
overcoming performance problems. 

Components of Performance 

In 1996, David Wiley studied five 
common models of human perfor- 
mance technology and produced a 
synthesis of the key factors that have 
been identified in the performance 
support literature (Figure 3). Wileys 
analysis suggests that performance is 
affected by seven variables: 


1. Organizational systems 

2. Incentives 

3. Cognitive support 

4. Tools 

5. Physical environment 

6. Skills/knowledge 

7. Inherent ability. 

In Wiley s estimation, the variables 
are sequenced in their ease of remedi- 
ation. That is, performance problems 
related to organizational systems 
are easier to modify than problems 
associated with intrinsic abilities. 

When a student encounters 
difficulties in the academic environ- 
ment, Wiley s model illustrates why 
educators have had limited success in 
closing the achievement gap by focus- 
ing all their efforts on instructional 
strategies and inherent abilities. The 
model also suggests other interven- 
tions for teachers to explore: changes 
in the organizational structure (e.g., 
change course sections), as well as 
changes in settings, or various incen- 
tive/motivational strategies. If all of 
these interventions fail to produce the 
desired level of student performance, 
two additional variables deserve fur- 
ther investigation: cognitive support 
and tools. 

Technology as Performance Support 

The nature of most learning activities 
our children complete is indistin- 
guishable from the way previous 
generations completed the same 
tasks. However, outside of schools, 
technology has fundamentally altered 
how some tasks are completed — 
the mortgage underwriter uses a 
spreadsheet, the mechanic uses an 
engine diagnostic system, and so on. 
Further, why is it that I have many 
choices of how to view a movie — 
by watching it on broadcast, cable, 
or satellite television; renting a video- 
tape or DVD; going to the theater or 
to a friend s house— but only one 
way to learn about American his- 
tory — by reading a textbook? 


D’s Algebra Performance 



T’s Algebra Performance 



K’s Algebra Performance 



L’s Algebra Performance 



Figure 2. Ninth grade student 
performance data from algebra 
homework. 


Recent educational innovations, 
such as differentiated instruction and 
universal design for learning, offer 
insights into proactively planning 
instruction that embraces academic 
diversity. Recognizing the need for 
both physical and cognitive access to 
learning provides a rationale for far- 
ranging searches of existing technolo- 
gies that fundamentally alter the way 
specific tasks can be completed. 
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Figure 3. Wiley’s model of human performance technology. 


Consider a few examples of technol- 
ogy tools that our grandparents didn’t 
have: 

• For students unable to indepen- 
dently read their textbooks, digital 
text and text-to-speech software 
such as ReadPlease (http://www. 
readplease.com) or Kurzweil 3000 
(http://www.kurzweiledu.com) ex- 
ist so that the student can listen to 
the information as it is read by the 
computer. 

• For students who struggle with the 
physical and mechanical tasks of 
generating a first draft of a paper, 

a dictation service such as iDictate 
(http://www.idictate.com) is avail- 
able that will prepare documents 
based on dictation provided over 
the telephone. 

• For students who experience dif- 
ficulty in recalling facts, Ask Jeeves 
for Kids (http://www.ajkids.com) 
teaches students how to retrieve 
information they do not know or 
remember. 

• For students with computational 
difficulties in math, there is Web- 
Math (http://www.webmath.com). 
This Web-based tool provides cal- 
culating and instructional support 
for solving math problems from el- 
ementary through graduate school. 


Data Illustrating Technology-enhanced 
Performance 

Figure 4 illustrates Nicks performance 
using a research design for measuring 
performance (in this case, solving 20 
algebra problems) with and without 
technology. To assess whether Web- 
Math contributes to Nicks enhanced 
performance, every other day the 
teacher assigns the homework to be 
completed in the typical paper and 
pencil format. On the other days 
Nick completes his homework using 
WebMath. After reviewing the data, 
does the difference between the two 
lines provide convincing evidence of 
the boost in performance that Nick 
is able to achieve as a result of his 
use of appropriate technology tools? 
Indeed, this example of WebMath il- 
lustrates the potential value of cogni- 
tive supports and technology tools for 
enhancing academic performance. 
However, it also raises a number of 
provocative questions that reveal we 
have yet to learn the lessons of the 
achievement gap. 

Bias: Naked Independence 

Education places a premium on 
knowledge that is contained in ones 
head. Performance that is completed 
without the aid of external devices and 
resources is prized over performance 


that is dependent on tools or re- 
sources. While this may be a historical 
artifact of society’s conception of the 
educated person, there is a clear bias 
here. As Samuel Johnson observed, 
“Knowledge is of two types: the kind 
you know and the kind you know 
how to find.” Researchers in assistive 
technology outcomes have termed this 
form of bias “naked independence,” 
as it exults the performance of able- 
bodied individuals and devalues the 
performance of others who must rely 
on external devices or tools. 

Teachers and administrators often 
react strongly to the example of Nick 
and WebMath. They argue that allow- 
ing Nick to use such a tool amounts to 
endorsing cheating. They argue that 
Nick cant really perform the task like 
the other students (notice the not-so- 
subtle bias of naked independence?). 
They argue that he is dependent on 
the tool. They wonder how he will be 
able to solve algebra problems when 
he isn’t connected to the Internet (he 
can’t; the data show that). They argue 
that Nick can’t possibly earn an A 
like other students who successfully 
complete problems without relying on 
a tool to help them. And, they argue 
that allowing Nick to use WebMath 
is not fair to the other students (e.g., 
high-achieving students who earn 
their A with sheer mental power, or 
other low- achieving students without 
access to technology). Finally, they 
argue that we should prevent Nick 
from ever using WebMath because 
this form of technology will not be al- 
lowed on the state’s high-stakes test. 

Notice how contentious the con- 
versation about technology- enhanced 
performance has become? The no- 
tion that technology can be used to 
enhance performance challenges tra- 
ditional roles (i.e., entitlement) held 
by those who can complete a task and 
claim their performance (naked inde- 
pendence) is superior to performance 
that is enhanced through technology. 
This subtle form of bias will be a pow- 
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erful force to overcome in the quest 
to provide struggling students with 
appropriate tools that enhance their 
functional performance. 

Grading 

Despite the routine collection of per- 
formance data in schools, the primary 
purpose of grades is to classify and 
rank-order students. Notice the ele- 
ments of entitlement that leak out of 
the naked independence bias: Its not 
fair that some students can earn an A 
by relying on technology while others 
have to devote significant mental en- 
ergy to completing the algebra prob- 
lems. Conventional thinking is that we 
cannot allow the two performances to 
be considered equivalent. As a result, 
we tend to ban technology tools under 
the guise that measuring naked inde- 
pendence is a better measure of per- 
formance, skill, and knowledge. Status 
quo maintained. 

Fairness 

Research on fairness indicates that 
most adults notions of fairness are ar- 
rested at the kindergarten level (e.g., 
“He got a blue M&M, and I didn’t!”). 


That is, fairness means everyone gets 
the same thing. However, the function- 
al definition of fairness is that every- 
one gets what they need. Much work 
remains to be done to provide every 
struggling student with the appropriate 
technology and tools he or she needs to 
be academically successful. 

Concluding Thoughts 

Despite the current educational re- 
form rhetoric about high academic 
standards, educational practice prefers 
to hold time constant rather than per- 
formance. That is, if all students are to 
achieve a given educational standard, 
then time and tools should vary to 
allow for differences in learning. How- 
ever, we prefer to hold time constant 
(e.g., one-day lessons, two-week units), 
moving on to the next topic despite 
the extreme variance in performance 
by the students within a class. If time 
is to be held constant, and traditional 
instruction has generally failed to 
produce acceptable levels of academic 
performance, then the only other via- 
ble options for enhancing performance 
are to provide cognitive supports and 
appropriate technology tools. 


Nick’s Algebra Performance 



Homework 
with WebMath 


Traditional 

Homework 


Figure 4. Nick’s algebra homework performance with and without WebMath visually 
demonstrates the contribution, or boost, that technology provides to his functional 
academic performance. 


When time is held constant and a 
single form of instruction or instruc- 
tional material is used, it is impossible 
to make claims that all students will 
achieve high standards. The historical 
lessons of the achievement gap have 
already taught us this. The use of tech- 
nology tools and cognitive supports 
represent essential and underutilized 
interventions for enhancing the 
academic performance of struggling 
students. The long-term consequences 
of academic failure must motivate the 
profession to intervene with carefully 
designed learning activities that en- 
sure success from the outset. 
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